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IMAGE PICKUP SYSTEM 

BACKGROUND OF THE INVENTION 
Field of the Invention 
5 The invention relates to an image pickup system 

for controlling a plurality of image pickup 
apparatuses . 
Related Background Art 

As image pickup systems using a plurality of 

10 image pickup apparatuses, for example, there are a 
system for displaying images photographed by the 
image pickup apparatuses by a multiscreen, a system 
for forming a 3-dimensional image of an object to be 
photographed, a system for measuring a distance to 

15 the object, and a system for forming a wide area 

image such as a panoramic image or the like. In such 
image pickup systems, it is necessary to synchronize 
image pickup processes of a plurality of image pickup 
apparatuses . 

20 However, the conventional image pickup system 

has a problem such that since a communication medium 
to transmit synchronization information for 
synchronizing the image pickup processes of a 
plurality of image pickup apparatuses is necessary in 

25 addition to a communication medium to transmit image 
data, wirings are troublesome and a system 
construction becomes complicated. 
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SUMMARY OF THE INVENTION 

The invention is made to solve the above problem 
and it is an object of the invention to synchronize 
image pickup processes of a plurality of image pickup 
5 apparatuses by using one kind of communication medium. 
According to a preferred embodiment of the 
invention, there is provided an image pickup system 
including a plurality of image pickup apparatuses 
connected to a predetermined communication medium, 

10 wherein one of the plurality of image pickup 

apparatuses comprises synchronization information 
generating means for generating synchronization 
information for synchronizing the plurality of image 
pickup apparatuses and transmitting means for 

15 transmitting the synchronization information to the 
plurality of image pickup apparatuses, and each of 
the plurality of image pickup apparatuses comprises 
receiving means for receiving the synchronization 
information, frame synchronization signal generating 

20 means for generating a frame synchronization signal 
on the basis of the synchronization information, and 
image data generating means for generating image data 
on the basis of the frame synchronization signal. 

Still other objects of the present invention, 

25 and the advantages thereof, will become fully 

apparent from the following detailed description of 
the embodiments . 
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BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a diagram showing an example of an 
image pickup system according to an embodiment; 

Fig. 2 is a flowchart for explaining a 
5 processing procedure for a control device according 
to the embodiment; 

Fig. 3 is a diagram for explaining a setting 
command according to the embodiment; 

Fig. 4 is a diagram showing a main construction 
10 of an image pickup apparatus according to the 
embodiment; 

Fig. 5 is a flowchart for explaining a 
processing procedure of the image pickup apparatus 
according to the embodiment; and 
15 Figs. 6A, 6B and 6C are diagrams showing timings 

of frame synchronization signals which are generated 
by the image pickup apparatuses (including a master 
camera) according to the embodiment. 

20 DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

A preferred embodiment of the invention will be 
described hereinbelow with reference to the drawings. 

Fig. 1 is a diagram showing an example of an 
image pickup system according to the embodiment. In 
2 5 the embodiment, an image pickup system using a high 
speed serial bus which conforms with, for example, 
the IEEE1394-1995 standard or its extended standard 
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(for example, IEEE1394a-2000 standard) will be 
explained . 

In Fig. 1, reference numeral 100 denotes a 
control device; 110 an image pickup apparatus; and 
5 120 a digital interface (hereinafter, referred to as 
an IEEE1394 interface) which conforms with the 
IEEE1394-1995 standard as one of the standards 
regarding the serial bus or its extended standard. 
The control device 100 is constructed by, for example, 

10 a computer, a television receiver, and the like. 

Each image pickup apparatus 110 is constructed by, 
for example, a digital video camera, a camera 
integrated type digital video recorder, a monitoring 
camera, or the like. Reference numerals 101 to 104 

15 denote display areas which a display device 105 

connected to the control device 100 has. The area 
101 displays image data of an image photographed by 
the image pickup apparatus A. The area 102 displays 
image data of an image photographed by the image 

20 pickup apparatus B. The area 103 displays image data 
of an image photographed by the image pickup 
apparatus C. The area 104 displays image data of an 
image photographed by the image pickup apparatus D. 
The control device 100 sets one image pickup 

25 apparatus 110 to "master camera" in accordance with a 
procedure, which will be explained hereinlater. The 
master camera generates synchronization information 
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(hereinbelow, referred to as a time stamp) for 
synchronizing frame synchronization signals of all of 
the image pickup apparatuses 110 (including the 
master camera) in accordance with a procedure, which 
5 will be explained hereinlater. All of the image 

pickup apparatuses 110 (including the master camera) 
generates the frame synchronization signals in 
response to the time stamp generated by the master 
camera in accordance with a procedure, which will be 

10 explained hereinlater. 

The IEEE1394 interface 120 automatically 
recognizes a topology of the system again each time a 
bus reset specified by the IEEE1394-1995 standard or 
its extended standard occurs. At this time, a node 

15 ID is automatically set into each IEEE1394 interface 
120. The node ID is a communication address 
specified by the IEEE1394-1995 standard or its 
extended standard. According to the IEEE1394-1995 
standard or its extended standard, a data packet is 

20 transmitted and received by using the node ID. 

The IEEE1394 interface 120 also has an 
Isochronous transfer system and an Asynchronous 
transfer system. The Isochronous transfer system is 
suitable for transmission of motion image data or 

25 audio data because a predetermined bandwidth can be 
assured every predetermined communication cycle 
(almost 125 usee) . The Asynchronous transfer system 
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is suitable for transmission of control information 
or a still image because it has a procedure which 
guarantees transmission of data packet. 

A processing procedure for the control device 
5 100 according to the embodiment will now be described 
with reference to Fig. 2. In Fig. 2, a procedure 
which is executed until the image pickup apparatus 
110 serving as a master camera is selected and a 
setting command is transmitted to each image pickup 

10 apparatus 110 will be explained. 

Step S201: The control device 100 discriminates 
whether the bus reset specified by the IEEE1394-1995 
standard or its extended standard has occurred or not. 
If the bus reset has occurred, step S202 follows. 

15 Step S202: The control device 100 obtains the node 
ID and device information of each image pickup 
apparatus 110. The device information includes data 
showing a bandwidth required for transmission of the 
image data. The control device 100 holds the node ID 

20 and device information of the image pickup 
apparatuses 110 into an internal memory. 

Step S203: The control device 100 assures 
isochronous resources (channel number and bandwidth) 
required for transmission and reception of the time 

25 stamp. The isochronous resources are managed by an 
isochronous resource manager specified by the 
IEEE1394-1995 standard. 



- 7 - 



Step S204: The control device 100 assures 
isochronous resources (channel number and bandwidth) 
required for transmission of the image data every 
image pickup apparatus 110. The control device 100 
5 holds the isochronous resources (channel number and 
bandwidth) obtained every image pickup apparatus 110 
into an internal memory. 

Step S205: The control device 100 selects one of 
the plurality of image pickup apparatuses 110 and 

10 sets the selected image pickup apparatus 110 to the 
master camera. As a method of selecting the image 
pickup apparatus 110 serving as a master camera, for 
example, one of the following four methods is used. 
The first method is a method whereby the image pickup 

15 apparatus 110 having the largest node ID is 

automatically set to the master camera. The second 
method is a method whereby the image pickup apparatus 
110 having the smallest node ID is automatically set 
to the master camera. The third method is a method 

20 whereby the image pickup apparatus 110 having the 
node ID selected at random is set to the master 
camera. The fourth method is a method whereby the 
image pickup apparatus 110 selected by the user is 
set to the master camera. 

25 Step S206: The control device 100 transmits the 
setting command to each image pickup apparatus 110. 
Fig. 3 shows main data included in the setting 
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command. Data 301 shows the isochronous resources 
(channel number and bandwidth) required for 
transmission of the image data. The data 301 differs 
every image pickup apparatus 110. Data 302 indicates 
5 the node ID of the image pickup apparatus 110 serving 
as a master camera. Data 303 shows the isochronous 
resources (channel number and bandwidth) required for 
transmission and reception of the time stamp. 
A main construction of the image pickup 

10 apparatus 110 according to the embodiment will now be 
described with reference to Fig. 4. 

In Fig. 4, reference numeral 401 denotes an 
image pickup unit; 4 02 an image processing unit; 4 03 
a cycle-time register; 404 a capture pulse generation 

15 unit; 405 a time stamp generation unit; 406 a frame 
synchronization signal generation unit; and 407 a 
control unit. 

The image pickup unit 401 photographs an optical 
image of an object to be photographed in response to 

20 the frame synchronization signal generated by the 

frame synchronization signal generation unit 406 and 
generates image data corresponding to the optical 
image of the object. The image processing unit 402 
converts the image data generated by the image pickup 

25 unit 401 into image data of a predetermined data 
format. The IEEE1394 interface 120 transmits the 
image data generated by the image processing unit 402 
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to the control device 100 by using the Isochronous 
transfer system specified by the IEEE1394-1995 
standard. The Isochronous transfer system is 
suitable for transmission of motion image data, audio 
5 data, or the like because a predetermined bandwidth 
can be assured every 125 usee. 

The cycle-time register 403 exists in a CSR 
(Control and Status Registers) architecture which the 
IEEE1394 interface 120 has. The cycle-time register 

10 403 stores time information (cycle time) for managing 
the communication cycle (almost 125 usee) specified 
by the IEEE1394-1995 standard or its extended 
standard. The cycle time stored in the cycle-time 
register 403 is updated by a cycle start packet in 

15 which a cycle master specified by the IEEE1394-1 995 
standard or its extended standard is broadcasted 
every 125 psec. After it is updated, the cycle time 
stored in the cycle-time register 403 is counted by 
clocks of 24.576 MHz. 

20 The time stamp generation unit 4 05 is made 

operative when the image pickup apparatus 110 is set 
to the master camera. The time stamp generation unit 
405 obtains the cycle time held in the cycle-time 
register 403 in response to the capture pulse 

25 generated by the capture pulse generation unit 404. 

Subsequently, the time stamp generation unit 405 adds 
a predetermined value cc to the obtained cycle time, 



thereby generating the time stamp. The predetermined 
value a is a value obtained by sufficiently taking 
into consideration a delay time that is caused by the 
transmission or the like of the time stamp. The time 
stamp generated by the time stamp generation unit 405 
is supplied to the frame synchronization signal 
generation unit 406 and IEEE1394 interface 120. The 
IEEE1394 interface 120 transmits the time stamp to 
each image pickup apparatus 110 (except for the 
master camera) by using the Isochronous transfer 
system. 

The frame synchronization signal generation unit 
406 executes different processes depending on whether 
the image pickup apparatus is the master camera or 
not. In case of the master camera, the frame 
synchronization signal generation unit 406 compares 
the time stamp generated by the time stamp generation 
unit 405 with the cycle time read out from the cycle- 
time register 403 and generates the frame 
synchronization signal when they coincide. In case 
of the image pickup apparatus other than the master 
camera, the frame synchronization signal generation 
unit 4 06 compares the time stamp received by the 
IEEE1394 interface 120 with the cycle time read out 
from the cycle-time register 403 and generates the 
frame synchronization signal when they coincide. 
Since timing for generating the frame synchronization 
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signal is controlled by the time stamp, it is 
generated at the timing that is delayed from a 
capture pulse by the time corresponding to the 
predetermined value a. The frame synchronization 
5 signal generated by the frame synchronization signal 
generation unit 406 is supplied to the image pickup 
unit 401, image processing unit 402, and IEEE1394 
interface 120. Thus, the image pickup process of 
each image pickup apparatus 110 (except for the 

10 master camera) is synchronized with the image pickup 
process of the master camera. 

Subsequently, a processing procedure of each 
image pickup apparatus 110 according to the 
embodiment will be described with reference to Figs. 

15 5 and 6A to 6C . Fig. 5 is a flowchart for explaining 
the processing procedure of each image pickup 
apparatus 110 according to the embodiment. Fig. 6A 
is a diagram showing timing for the capture pulse 
which is generated by the master camera. Fig. 6B is 

20 a diagram showing timing for the frame 

synchronization signal which is generated by the ' 
master camera. Fig. 6C is a diagram showing timing 
for the frame synchronization signal which is 
generated by each image pickup apparatus 110 (except 

25 for the master camera) . 

Step S501: The control unit 407 discriminates 
whether the IEEE1394 interface 120 has received the 
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setting command transmitted from the control device 
100 or not. If the setting command is received, step 
S502 follows. If NO, the present processing routine 
is finished. 

5 Step S502: The control unit 407 compares the data 
302 (node ID of the master camera) of the setting 
command with its own node ID. When they coincide, 
the image pickup apparatus is set to the master 
camera. In case of the master camera, step S503 

10 follows. In case of the image pickup apparatus other 
than the master camera, step S507 follows. 

Step S503: The time stamp generation unit 405 of 
the master camera generates the time stamp in 
accordance with a capture pulse 601 generated by the 

15 capture pulse generation unit 404. The time stamp 
generated by the time stamp generation unit 405 is 
supplied to the frame synchronization signal 
generation unit 406 and IEEE1394 interface 120. 

Step S504: The IEEE1394 interface 120 of the master 

2 0 camera transmits the time stamp generated by the time 
stamp generation unit 4 05 to each image pickup 
apparatus 110 (except for the master camera) by using 
the Isochronous transfer system. The IEEE1394 
interface 120 isochronously transfers the time stamp 

25 by using the data 303 (including the channel number 

and bandwidth required for transmission and reception 
of the time stamp) of the setting command. 
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Step S505: The frame synchronization signal 
generation unit 406 of the master camera compares the 
time stamp generated by the time stamp generation 
unit 405 with the cycle time read out from the cycle- 
5 time register 403 and generates a frame 

synchronization signal 602 when they coincide. As 
shown in Figs. 6A to 6C, the frame synchronization 
signal 602 is generated at the timing that is delayed 
from the capture pulse 601 by the time corresponding 

10 to the predetermined value a. The frame 

synchronization signal generated by the frame 
synchronization signal generation unit 406 is 
supplied to the image pickup unit 401, image 
processing unit 402, and IEEE1394 interface 120. 

15 Step S506: The image pickup unit 401 of the master 
camera photographs the optical image of the object to 
be photographed in response to the frame 
synchronization signal 602 and generates the image 
data corresponding to the optical image of the object. 

20 The image processing unit 402 converts the image data 
generated by the image pickup unit 4 01 into the image 
data of a predetermined data format. The IEEE1394 
interface 120 transmits the image data generated by 
the image processing unit 402 to the control device 

25 100 by using the Isochronous transfer system 
specified by the IEEE1394-1995 standard. The 
IEEE1394 interface 120 isochronously transfers the 
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image data by using the data 301 (including the 
channel number and bandwidth required for 
transmission of the image data) of the setting 
command. The control device 100 receives the image 
5 data isochronously transferred from the master camera 
and displays the image data onto the display device 
105. 

Step S507: The IEEE1394 interface 120 of each image 
pickup apparatus 110 (except for the master camera) 

10 receives the time stamp transmitted from the master 

camera. The IEEE1394 interface 120 receives the time 
stamp isochronously transferred from the master 
camera by using the data 303 (including the channel 
number and bandwidth required for transmission and 

15 reception of the time stamp) . 

Step S508: A frame synchronization signal 
generation unit 4 06 of each image pickup apparatus 
110 (except for the master camera) compares the time 
stamp received by the IEEE1394 interface 120 with the 

20 cycle time read out from the cycle-time register 403 
and generates a frame synchronization signal 603 when 
they coincide. As shown in Figs. 6A to 6C, the frame 
synchronization signal 603 is generated at the timing 
that is delayed from the capture pulse 601 by the 

25 time corresponding to the predetermined value a. By 
constructing the system as mentioned above, each 
image pickup apparatus 110 (except for the master 
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camera) can generate the frame synchronization signal 
603 at the same timing as that of the frame 
synchronization signal 602 of the master camera. The 
frame synchronization signal generated by the frame 
synchronization signal generation unit 406 is 
supplied to the image pickup unit 401, image 
processing unit 402, and IEEE1394 interface 120. 
Thus, the image pickup process of each image pickup 
apparatus 110 (except for the master camera) is 
synchronized with the image pickup process of the 
master camera. 

Step S509: The image pickup unit 401 of each image 
pickup apparatus 110 (except for the master camera) 
photographs the optical image of the object in 
response to the frame synchronization signal 603 and 
generates the image data corresponding to the optical 
image of the object. The image processing unit 402 
converts the image data generated by the image pickup 
unit 401 into the image data of a predetermined data 
format. The IEEE1394 interface 120 transmits the 
image data generated by the image processing unit 402 
to the control device 100 by using the Isochronous 
transfer system specified by the IEEE1394-1995 
standard. The IEEE1394 interface 120 isochronously 
transfers the image data by using the data 301 (the 
channel number and bandwidth required for 
transmission of the image data) of the setting 
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command. The control device 100 receives the image 
data isochronously transferred from each image pickup 
apparatus 110 (except for the master camera) and 
displays the image data onto the display device 105. 
5 As described above, according to the image 

pickup system of the embodiment, the image pickup 
processes of a plurality of image pickup apparatuses 
can be easily synchronized by using the communication 
medium which conforms with the IEEE1394-1995 standard 

10 or its extended standard. 

The invention may be embodied in other specific 
forms without departing from essential 
characteristics thereof. Therefore, the above- 
described embodiments are merely exemplary of this 

15 invention, and are not be construed to limit the 
scope of the present invention. 

For example, although the embodiment has been 
described with respect to the example of using the 
communication medium which conforms with the 

20 IEEE1394-1995 standard or its extended standard, the 
invention is not limited to it. A communication 
medium which conforms with a standard other than the 
IEEE1394-1995 standard can be also used so long as it 
is a communication medium having a function for 

25 managing a predetermined communication cycle. 

The functions of the embodiment mentioned above 
can be also accomplished by a method whereby, for 
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example, a recording medium on which program codes of 
software to realize the functions of the embodiment 
mentioned above have been recorded is supplied to a 
system or an apparatus, and a computer (a CPU or an 
5 MPU) of the system or apparatus reads out the program 
codes stored on the recording medium and executes 
processes according to the program codes. 

In this case, the program codes themselves read 
out from the recording medium realize the functions 

10 of the embodiment mentioned above. The recording 

medium on which the program codes have been recorded 
constructs the invention. As a recording medium, it 
is possible to use a magnetic disk, an optical disk, 
a magnetooptic disk, a CD-ROM, a magnetic tape, a 

15 non-volatile memory card, an ROM, or the like. 

The invention incorporates not only a case where 
a computer executes the read-out program codes, so 
that the functions of the embodiment mentioned above 
can be realized but also a case where an OS or the 

20 like which is operating on the computer executes a 
part or all of actual processes on the basis of 
instructions of the program codes, and the functions 
of the embodiment mentioned above are realized by 
those processes. 

25 Further, the invention incorporates a case where 

the program codes read out from the recording medium 
are written into a memory provided for a function 
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expanding board inserted into a computer or a 
function expanding unit connected to a computer and, 
thereafter, a CPU or the like provided for the 
function expanding board or function expanding unit 
5 executes a part or all of actual processes in 

accordance with instructions of the program codes, 
and the functions of the embodiment mentioned above 
are realized by those processes. 

In case of applying the invention to the 

10 recording medium, the program codes corresponding to 
the above-described processes are stored into the 
recording medium. However, explaining in brief, 
modules which are indispensable to the invention are 
stored into the recording medium. 

15 The scope of the present invention is defined by 

the scope of the appended claims, and is not limited 
to only the specific descriptions in this 
specification. Furthermore, all the modifications 
and changes belonging to eguivalents of the claims 

20 are considered to fall within the scope of the 
present invention. 



